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(54) Self-contained mapping and positioning system utilizing point cloud data 



(57) A self-contained mapping and positioning sys- 
tem for underground mining is provided that is capable 
of mapping the topography of a region, such as a mine 
tunnel, and further being able to use the mapped data 
to determine the position of an object, such as a mining 
vehicle, within the mine tunnel. The system includes an 
inertial navigation system (12), a central processing unit 
(14), a three-dimensional database (16), a three-dimen- 
sional camera system (18), an operator console (20) 
and a survey system having a three-dimensional laser 
scanner. The survey system using the three-dimension- 
al laser scanner produces point cloud data, i.e., a set of 
data points representing the topography of the region. 
The point cloud data is stored within a storage device 
until the entire region is mapped and then transmitted 
to the operator console to be post processed. After post 
processing, the data is exported to the three-dimension- 
al database (16) and then indexed for ease of use by 
the central processing unit. To determine the position of 
the object within the region, the system of the instant 
invention initializes the object in its current position. The 
object is then either remotely or directly guided to an- 
other position from the current position where it is 
brought to an estimated position by the inertial naviga- 
tion system (12) or is remotely controlled for performing 
work, e.g., drilling a mine heading. After a predeter- 
mined time of moving the object, there is an error in the 
position of the object and the operator console makes 
a call to the central processing unit (14) on board the 
object to automatically calculate the true position based 
on the point cloud data stored within the database to 
update the position of the object. This is done by ap- 
proximating a search range for the database (16) ac- 
cording to the estimated position. A subset of data cor- 



responding to the search range is removed from the da- 
tabase (16). The three-dimensional camera system 
then scans images of the surface in proximity to the ob- 
ject and converts the images to a patch of point cloud 
data. The patch of point cloud data is then matched 
against the subset of data corresponding to the search 
range of point cloud data removed from the three-di- 
mensional database (16) until there is less than a pre- 
determined minimum error distance. At that point, the 
true position of the object is known. This new position is 
then put back into the inertial navigation system (12) and 
the positional data of the object is updated with the cor- 
rect positional data. 
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Description 
TECHNICAL FIELD 

[0001] The instant invention relates to mapping and 
positioning techniques in general and, more particularly, 
to a self-contained mapping and positioning system es- 
pecially suited for determining the position of an object 
located within a region, such as a mining vehicle within 
a mine tunnel, utilizing point cloud data, i.e., a set of data 
points representing the topography of the region. 

BACKGROUND ART 

[0002] Mine tunnel outline plan views ("TOPES") are 
required for underground mine planning. Present tech- 
niques require teams of skilled surveyors using conven- 
tional surveying techniques and equipment to physically 
traverse the stopes and drifts to obtain the raw data for 
the topes. The raw data consists of point-to-point meas- 
urements. The mapping data collected by the surveyors 
is imported into a CAD package to produce mine tunnel 
plan views. 

[0003] Sending surveying crews into underground ex- 
cavations can be tedious work. Moreover, the assem- 
bling and utilization of highly skilled personnel contrib- 
utes to the cost of underground mining. 
[0004] Due to the ceaseless press of cost reduction 
and heightened safety concerns, there is a continuing 
desire on the part of hard rock miners to automate min- 
ing systems. By automating as many and minimizing cy- 
cles as possible, the dangers and expenses caused by 
the presence of personnel at the actual working zones 
of the mine may be reduced. By placing the miner or 
other mine professional in a safe and secure remote lo- 
cation, preferably at the surface, increased safety, cost 
efficiency and production are encouraged. 
[0005] In particular, robotic mining techniques require 
dependable mapping, navigation and positioning sys- 
tems. For surface mining (as well as other activities), 
increasing success has been found with the use of glo- 
bal positioning systems utilizing earth satellite naviga- 
tion. 

[0006] However, in underground mines and in certain 
surface structures, the signals from the orbiting satel- 
lites cannot reach the targeted equipment. Accordingly, 
sophisticated dead reckoning systems have been de- 
veloped. Typical systems utilize sound, electromagnetic 
means (lasers, visible light, radar) or gyroscopes or 
combinations thereof to remotely guide and operate mo- 
bile underground equipment. 

[0007] A difficulty with remotely operated equipment 
is securing an initial reference datum point in X-Y-Z 
space. Due to the relative complex location algorithms 
used in navigation systems, the jumping off point must 
be measured with great accuracy otherwise even small 
errors will quickly become magnified thereby throwing 
off the reconnoitering ability of the apparatus. This prob- 



lem is especially onerous if a toping system is involved. 
Any deviation may render the resulting map worthless 
when critical parameters are at stake. 
[0008] Further, dead reckoning systems, may render 
5 false mapping, navigation and positioning readings due 
to natural phenomenon, such as electrical storms, and 
the uneven, crater-like surface of the mine or an over- 
head surface which tend to roll and shake the vehicle 
carrying laser equipment and/or gyroscopes. 
[0009] Accordingly, there is a need to produce less la- 
bor intensive accurate topes of underground regions, 
enclosed structures, and overhead surfaces for later 
use in navigating and positioning an object, such as a 
mining vehicle within a mine tunnel. 
[0010] A need also exists in developing a self-con- 
tained mapping and positioning system which does not 
use global positioning and dead reckoning systems in 
positioning an object and determining the position of the 
object within a region after an initial reference position 
of the object is known. 

SUMMARY OF THE INVENTION 

[0011] There is provided a self-contained mapping 
and positioning system that is capable of mapping the 
topography of a region, such as a mine tunnel, and fur- 
ther being able to use the mapped data to determine the 
position of an object, such as a mining vehicle within the 
mine tunnel. The system includes an inertial navigation 
system, a central processing unit, a three-dimensional 
database, a three-dimensional camera system, an op- 
erator console and a survey system having a three-di- 
mensional laser scanner. 

[0012] The survey system which is capable of an ac- 
curacy of temm over 12m is attached to a vehicle that is 
remotely operated through the region. The survey sys- 
tem using the three-dimensional laser scanner produc- 
es point cloud data, i.e., a set of data points representing 
the topography of the region, as well as raster imagery. 
The point cloud data is stored within a storage device 
until the entire region is mapped and then is transmitted 
to the operator console to be post processed. The post 
processing involves the consolidation and verification of 
the data collected in the field and setting the data in the 
requested coordinates. The final step is the exporting of 
the information to the three-dimensional database and 
the indexing of the data for ease of use by the central 
processing unit. 

[0013] To determine the position of the object within 
the region, the system of the instant invention initializes 
the mining vehicle in its current position or initial refer- 
ence point ("IRP"), as described in co-pending U.S. Pat- 
ent Application Serial No. 09/515,299 titled "Automated 
Guided Apparatus Suitable for Toping Applications" filed 
on February 29, 2000 and having a common assignee; 
the contents of which are incorporated herein by refer- 
ence. The IRP is fixed with respect to the point cloud 
data stored within the database. The object is then either 
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remotely or directly guided from the IRP to another po- 
sition where it is brought to an estimated position by the 
inertial navigation system or is remotely controlled for 
performing work, e.g., drilling a mine heading. 
[0014] After a predetermined time of moving the ob- 
ject, there is an error in the position of the object and 
the operator console makes a call to the central process- 
ing unit on board the object to automatically calculate 
the true position based on the point cloud data stored 
within the database to update the position of the object. 
This is done by approximating a search range for the 
database according to the estimated position. A subset 
of data corresponding to the search range is removed 
from the database. The three-dimensional camera sys- 
tem then scans images of the surface in proximity to the 
object and converts the images to a patch of point cloud 
data. The patch of point cloud data is then matched us- 
ing a matching algorithm against the subset of data cor- 
responding to the search range of point cloud data re- 
moved from the three-dimensional database until there 
is less than a predetermined minimum error distance, 
preferably, in the range of 2-4cm. At that point, the true 
position of the object is known. This new position is then 
put back into the inertial navigation system and the po- 
sitional data of the object is updated with the correct po- 
sitional data. 

[001 5] The invention is especially useful for guiding a 
mining vehicle within a mine tunnel from an initial refer- 
ence point, determining the position of the mining vehi- 
cle with respect to the initial reference point, and updat- 
ing the positional data associated with the mining vehi- 
cle. It also may be used for guiding, determining the po- 
sition, and updating the positional data of other objects, 
such as overhead surface vehicles. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0016] Figure 1 is a schematic representation of an 
embodiment of a self-contained mapping and position- 
ing system of the invention. 

[0017] Figure 2 is a schematic representation of a sur- 
vey system for use with the system of Figure 1 for scan- 
ning the topography of a region and forming point cloud 
data. 

[001 8] Figure 3 is a flow chart of a method for mapping 
and positioning an object according to the invention. 
[0019] Figure 4 is an illustration of point cloud data 
created by the system of Figure 2. 

PREFERRED EMBODIMENT OF THE INVENTION 

[0020] Referring to Figure 1 , there is shown a sche- 
matic diagram of a self-contained mapping and position- 
ing system that is capable of mapping the topography 
of a region, such as a mine tunnel, and further being 
able to use the mapped data to determine the position 
of an object, such as a mining vehicle, within the mine 
tunnel. The invention is described herein in the context 
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of guiding a mining vehicle located within a mine tunnel 
from an initial reference point, determining the position 
of the mining vehicle with respect to the initial reference 
point, and updating the positional data associated with 
5 the mining vehicle. 

[0021] It is contemplated that the system may also be 
used in guiding, determining the position, and updating 
the positional data of any object situated within any en- 
closure, such as a mine, tunnel, cave, building, etc., or 
10 overhead (i.e., external) surface, such as a rocky terrain. 
It is also contemplated that the system may also be used 
to map and represent the topography of any region in 
point cloud data, including a mine, tunnel, cave, build- 
ing, overhead (i.e., external) surface, etc. In the context 
15 of the description herein, the term "mapping the topog- 
raphy of a region" refers to representing the surface fea- 
tures of the region, including its relief and rivers, lakes, 
etc., and such man-made features as canals, bridges, 
ditches, roads, walls, furnishings, etc., in point cloud da- 
ta. 

[0022] The system designated generally by reference 
numeral 10 typically includes an inertial navigation sys- 
tem 12, a central processing unit 14, a three-dimension- 
al database 16, a three-dimensional camera system 18, 
and an operator console 20. The system 10 also in- 
cludes a process control station 15 for overseeing the 
entire mining operation and a proximity laser system 17 
for determining distance between the mining vehicle 
and an obstacle, such as a wall of a heading. The prox- 
imity laser system 1 7 is also used to align the mining 
vehicle, i.e., line up the mining vehicle with a mine head- 
ing or face. It is preferred that information transmitted 
from the proximity laser system 1 7 is displayed via a win- 
dow on the operator console 20 for aiding the operator 
to align the mining vehicle by remote control. Once the 
mining vehicle is properly aligned, the jacks of the min- 
ing vehicle are lowered to stabilize the mining vehicle. 
[0023] A diagnostic terminal system 1 9 having a key- 
board 19A, a mouse 19B and a monitor 19C is connect- 
ed to the central processing unit 14 for allowing an op- 
erator to periodically run diagnostic procedures and 
view any system problems on monitor 19C, i.e., for 
checking the integrity of the system 10. Preferably, the 
diagnostic terminal system 19 is located overhead, i.e., 
outside the mine tunnel, and communicates with the 
central processing unit 14 via appropriate communica- 
tion means, such as an RS232/422 cable, Ethernet 
links, underground rated radio frequency links or via oth- 
er communication methods as known in the art. It is con- 
templated that the diagnostic terminal system 19 and 
central processing unit ("CPU") 14 comprise a personal 
computer ("PC"). 

[0024] The system 1 0 further includes network devic- 
es as known in the art for connecting the various com- 
ponents described above in a network. The network de- 
vices typically include a head end 22, a distributed an- 
tenna translator ("DAT") 24 and a bridge hub 26. These 
three network devices are preferably connected via 
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standard network connections. For example, a broad- 
band cable 28 connects the head end 22 with the DAT 
24, and a data bus 30 connects the three-dimensional 
database 16 with the operator console 20 and the head 
end 22. 

[0025] A feeder line 32 transmits signals wirelessly 
from the bridge hub 26 to the DAT 24, an Ethernet line 
34 connects the central processing unit 14 with the 
bridge hub 26, and a cable 36, preferably, an RS 
232/422 cable, connects the central processing unit 14 
with the inertial navigation system 12, the three-dimen- 
sional camera system 18, and the proximity laser sys- 
tem 17. The bridge hub 26 communicates via standard 
communication techniques as known in the art, e.g., 
wireless, cable connection, etc., with a teleoperation 
system 38, i.e., a remote control system, for remotely 
controlling the mining vehicle and a machine function 
system 40 for changing operating modes of the mining 
vehicle and other mining machinery. 
[0026] The inertial navigation system 12, the central 
processing unit 14, the three-dimensional camera sys- 
tem 18, and the proximity laser system 17 are located 
on the mining vehicle. It is contemplated, however, that 
the central processing unit 1 4 together with the diagnos- 
tic terminal system 19 is located overhead and commu- 
nicates with the inertial navigation system 12, the three- 
dimensional camera system 18 and the proximity laser 
system 1 7 via at least one transmission medium and via 
at least the bridge hub 26. 

[0027] With reference to Figure 2, the invention fur- 
ther includes a survey system designated generally by 
reference numeral 50. The survey system 50 includes 
a three-dimensional laser scanner 52 attached to a ve- 
hicle that is remotely operated through the mine tunnel. 
The scanner 52 is used to generate a three-dimensional 
map of the mine tunnel. An air compressor 54 is con- 
nected to the scanner 52 via a pressurized cable 56 for 
keeping debris and dust out of the scanner 52. 
[0028] In operation, as the vehicle is advanced 
through the mine tunnel, the three-dimensional laser 
scanner 52 scans the length of the mine tunnel, or a por- 
tion thereof. Data processing means 58 (CPU, card, 
software, etc) having storage means 60 (tape, disc, 
RAM, etc) is connected to the three-dimensional laser 
scanner 52 via a cable 62. The data processing means 
58 receives the scanned data via the cable 62 from the 
scanner 52 and converts the scanned data into point 
cloud data, i.e., a set of multiple data points representing 
the surface of the mine tunnel, as shown by Figure 4, 
and raster imagery, using conventional software as 
known in the art, such as 3DIPSOS™ available from 
Mensi, Inc. of Atlanta, Georgia. The three-dimensional 
laser scanner 52 of the survey system 50 is preferably 
a SOISIC™ sensor having a NTSC video camera avail- 
able from Mensi, Inc. 

[0029] Preferably, the survey system 50 is capable of 
an accuracy of Hmm over 12m. The point cloud data for 
the surface of the mine tunnel is typically stored within 
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the storage means 60 until the scanning operation is 
complete, i.e., the desired length of the mine tunnel is 
mapped. The point cloud data is then transmitted, pref- 
erably, wirelessly by at least one radio frequency ("RF") 
5 modem 64A to at least one other RF modem 64B locat- 
ed overhead, i.e., on the surface, to a computer 66 to 
be post processed and to a video monitor 68 for viewing 
the data. 

[0030] It is contemplated that the computer 66 may 

10 be the same as the operator console 20 of Figure 1. It 
is further contemplated that the computer 66 may in- 
clude remote control capabilities for remotely controlling 
the three-dimensional laser scanner 52. 
[0031] The post processing of the data involves the 

15 consolidation and verification of the data collected in the 
field and setting the data in the requested coordinates. 
The final step is the exporting of the data mapping the 
surface of the mine tunnel from the computer 66 to the 
three-dimensional database 16 of Figure 1 and the in- 

20 dexing of the data for ease of use by at least the central 
processing unit 14 to determine the position the mining 
vehicle, as further described below. 
[0032] To determine the position of the mining vehicle, 
such as the drill jumbo, within the mine tunnel, the iner- 

25 tial navigation system 1 2 initializes the mining vehicle in 
its current position as described in co-pending U.S. Pat- 
ent Application Serial No. 09/515,299 titled "Automated 
Guided Apparatus Suitable for Toping Applications" filed 
on February 29, 2000 and having a common assignee; 

30 the contents of which are incorporated herein by refer- 
ence. In particular, the mining vehicle is either remotely 
or directly guided to a known initial position in the mine 
tunnel, i.e., the initial reference point ("IRP"). The IRP 
is also a known reference point in the mapping of the 

35 mine tunnel stored in the three-dimensional database 
16. 

[0033] A positioner on the mining vehicle using a 
mounted gyroscopic navigation system having a ring la- 
ser gyroscope detects the IRP and establishes its align- 

40 ment bearings within the mine tunnel. Since external po- 
sitioning and referencing positions cannot easily reach 
the interior of the mine tunnel, the mounted gyroscopic 
navigation device of the inertial navigation system 12 is 
preferred to negotiate the excavation and determine the 

45 IRR 

[0034] Due to the relatively irregular floor surface of 
the mine tunnel with boulders, ruts, contours, irregular 
surfaces, etc., mechanical rotating mass gyroscopes, 
sophisticated as they are, may experience jarring and 

50 repeated vibrations eventually resulting in errors and 
physical breakage. A ring laser gyroscope, with no mov- 
ing parts and robust construction, is preferable, since it 
stands up well to the rough usage envisioned for mine 
toping operations. 

55 [0035] In brief, a ring laser gyroscope fires opposing 
laser beams over a closed triangular path. If the gyro- 
scope is at rest, the two beams essentially cancel each 
other out resulting in a null state as detected by the ap- 
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propriate sensors. If the gyroscope is moved, the op- 
posing beams are simultaneously slightly foreshortened 
or lengthened as the case may be resulting in a meas- 
urable differential phase change. Using the gyroscope 
manufacturer's proprietary software, the intelligence 
can be manipulated to measure the change in position 
in three dimensions along with the change in pitch, alti- 
tude, roll and azimuth. 

[0036] In particular, Honeywell, Inc. of St. Petersburg, 
Florida sells a strapdown civilian inertial navigation sys- 
tem 12 employing a ring laser gyroscope called a Hon- 
eywell Ore Retrieval Tunneling Aid ("HORTA"™). The 
U.S. coal industry utilizes HORTA™ units in some un- 
derground continuous mining systems. These mining 
devices can be partially automated, allowing the opera- 
tor to monitor a machine's progress from a more secure 
location. These coal machines are mainly concerned 
with azimuth whereas hard rock mining applications re- 
quire azimuth and position. 

[0037] In a preferred embodiment of the instant inven- 
tion, the inertial navigation system 12, used to measure 
changes in location from the known IRP, utilizes the 
Honeywell HORTA™ and its proprietary software to 
communicate with the central processing unit 14. 
[0038] After the inertial navigation system 1 2 has de- 
tected the IRP, the mining vehicle is advanced either di- 
rectly or by remote control through the mine tunnel or is 
remotely controlled for performing work, e.g., drilling a 
mine heading. At a point in time after moving from the 
IRP, there is an error in the position of the mining vehicle 
as measured by the inertial navigation system 12. The 
operator using the operator console 20 makes a call to 
the central processing unit 14 on board the mining ve- 
hicle to automatically calculate the true position of the 
mining vehicle using the system 1 0 of Figure 1 . The cal- 
culated true position will then be used to update the po- 
sition of the mining vehicle. 

[0039] To update the position of the mining vehicle, 
an algorithm converted into a series of programmable 
instructions is executed by the central processing unit 
14, or other processor within the system, as discussed 
below in conjunction with Figure 3, to approximate a 
search range for the three-dimensional database 16 ac- 
cording to the estimated position as generated by the 
inertial navigation system 12. A subset of data corre- 
sponding to the search range is removed from the da- 
tabase 16 and transmitted to the central processing unit 
14. 

[0040] The three-dimensional camera system 1 8 then 
scans images of the surface of the mine tunnel and con- 
verts the images using proprietary software similar to 
the software used by the survey system 50 to a patch 
of point cloud data. The camera system 18 includes 
three-lenses for scanning three-dimensional images. In 
a preferred embodiment, the camera system 18 is the 
TRICLOPS™ stereo camera system available from 
Point Grey Research, Inc. of Vancouver, British Colum- 
bia, Canada. 



[0041 ] The patch of point cloud data is matched using 
a matching algorithm against the subset of data corre- 
sponding to the search range of point cloud data re- 
moved from the three-dimensional database 16 until 

5 there is less than a predetermined minimum error dis- 
tance, preferably, in the range of 2-4cm. In particular, 
the matching algorithm moves the patch of point cloud 
data over the search range of point cloud data until the 
patch of point cloud data approximately corresponds to 

10 a portion of the point cloud data removed from the da- 
tabase 16. At that point, the true position of the mining 
vehicle is known by correlating the matched position in 
the point cloud data (as removed from the database 16) 
with the location of the three-dimensional camera sys- 

15 tern 18 in the mine tunnel. 

[0042] This new position of the mining vehicle is then 
put back into the inertial navigation system 12 and the 
positional data of the mining vehicle is updated with the 
correct positional data. Preferably, the updated position- 

20 al data of the mining vehicle is displayed on the operator 
console 20 and/or the process control console 15 via a 
window resembling a virtual dashboard. 
[0043] At regular intervals, the survey system 50 is re- 
activated to map the mine tunnel, in the manner dis- 

25 cussed above, past the point where the survey system 
50 last left off, since the mine tunnel may have been 
lengthened, widened, etc. due to the work of the mining 
vehicle, e.g., the mining vehicle may have drilled past 
the point the survey system 50 last mapped. The new 

30 data collected by the survey system 50 is converted to 
point cloud data and is transmitted to the three-dimen- 
sional database 16 to append the data stored within the 
database 16. It is contemplated that the survey system 
50 may be provided on the mining vehicle itself. 

35 [0044] Accordingly, the system 1 0 of the instant inven- 
tion is able to map, navigate, position and update the 
position of a mining vehicle without the use of global po- 
sitioning systems and dead reckoning systems (except 
in detecting the IRP). Further, the system 10 is self-con- 

^o tained, i.e., no communications are necessary to out- 
side systems, such as global positioning systems, sonar 
systems, etc. Additionally, the system 10 includes re- 
mote control capabilities and an operator console 20 for 
controlling and overseeing the functions of the system 

45 10, especially the mining operations from a remote lo- 
cation. 

[0045] Referring to Figure 3, a description will now be 
provided of the algorithm used by the system and meth- 
od of the instant invention to determine the position of 

50 an object in an underground mine and to update the po- 
sitional data of the object accordingly. As shown by in- 
puts 400A, 400B and 400C, the algorithm uses as inputs 
the database 16 containing the three-dimensional point 
cloud data represented the topography of the under- 

55 ground mine (input 400A), the position estimate of the 
mining vehicle, preferably, in Universal Transverse Mer- 
cator ("UTM") coordinates (input 400B), and the mount- 
ing position of the three-dimensional camera system 18 
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on the mining vehicle (input 400C). 
[0046] The algorithm is embodied in proprietary soft- 
ware available from Point Grey Research Inc. More par- 
ticularly, the preferred software actually is comprised of 
two parts. 1) The TRICLOPS Stereo Vision SDK (soft- 
ware development kit) which is the basic stereo vision 
library; and 2) a Delaunay 2d Mesh library for building 
and manipulating two dimensional Delaunay triangula- 
tions. 

[0047] In step 410, all point cloud data points are ex- 
tracted from the database 16 that are within a range of 
5-7mofthe vehicle position, i.e., input 400b. Instep420, 
the estimated viewpoint of the camera system 18 is de- 
termined in Universal Transverse Mercator ("UTM") co- 
ordinates by applying input 400C to input 400B. In step 
430, all point cloud data points from the point cloud data 
points extracted in step 410 are determined that are 
within the field of view of a virtual camera positioned at 
the estimated position (i.e., the position determined in 
step 420) within a field of view of 90 degrees (both hor- 
izontal and vertical field of view). This set of data points 
represents the topography of the tunnel surface that the 
camera system 18 should be able to see. This set of 
tunnel data points is referred hereinafter as TP. Figure 
4 shows an actual tunnel surface comprised of collected 
point cloud data points. 

[0048] In step 440, a three-dimensional wire-frame 
mesh (analogous to the patch of point cloud data de- 
scribed above) with all data points in TP being used as 
vertices is constructed. This mesh is a surface approx- 
imation of the tunnel surface and is created by connect- 
ing the data points in TP with mesh edges. The connec- 
tions are chosen by performing a two-dimensional De- 
launay Triangulation, as known in the art, with the data 
points that result from projecting all data points in TP 
onto the image plane of the virtual camera. The facets 
of this mesh approximate the tunnel surface with three- 
dimensional triangles. In step 450, the estimated posi- 
tion of the camera system 18 determined in step 420 is 
applied to the point cloud data points obtained from the 
depth image of the camera system 18 (input 400D) to 
obtain a set of data points, hereinafter referred to as SP, 
within the same UTM coordinate system as the wire- 
frame mesh constructed in step 440. 
[0049] An iterative least-squares minimization is initi- 
ated in step 460 to obtain a correction of the camera 
position. Step 460 entails that for each point P in SP, the 
point Q in TP which is closest to P is determined (step 
460A); the three-dimensional triangle facet F that has Q 
as a vertex and has the minimum perpendicular dis- 
tance to P is determined (step 460B); and a pair point 
P, PP is created that is the perpendicular projection of 
P onto F (step 460B). In step 460C, the average dis- 
tance of all data points in SP from P to PP is determined 
and whether the average distance is greater than a stop- 
ping threshold, e.g., 3cm. If no, then step 460D is per- 
formed to adjust the estimated camera position deter- 
mined in step 420 to minimize the sum of the squares 
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of the distances P to PP. The iterative loop then pro- 
ceeds back to step 460A. 

[0050] If the answer in step 460C is yes, then step 460 
outputs the corrected position of the camera system 18 
5 within the three-dimensional tunnel scan (output 470). 
Step 480 entails using the corrected position of the cam- 
era system 18 (output 470) and the mounting position 
of the camera system 18 on the mining vehicle (input 
400C) and reversing the coordinate system transforma- 
tion (using a homogeneous coordinate transformation 
technique) as known in the art to determine a new po- 
sition for the mining vehicle. This new position is the up- 
dated mining vehicle position within the UTM coordinate 
system which is used to update the positional data of 
the mining vehicle as described above, i.e., replace the 
current input 400B. 

[0051] It is noted that UTM is a standard mapping grid 
system based on known mercator projections that the 
HORTA™ inertial navigation system 12 reports posi- 
tions in. It generates a Northing, Easting and Altitude in 
the UTM coordinate system. 

[0052] UTM is in the metric system. However, since 
many mines are already plotted using English measure- 
ments, it is necessary to convert the metric UTM coor- 
dinate system to the English unit Modified Basin System 
("MBS") using conversion equations as known in the art. 
[0053] Although the above discussion primarily re- 
lates to a self-contained mapping and positioning sys- 
tem for underground mining where a three-dimensional 
camera system is placed on the mining vehicle, such as 
a drill jumbo, the underlying inventive concept can be 
miniaturized so that a person walking in an accessible 
area could quickly and accurately generate a scan and 
convert the scan into point cloud data for determining 
the position of the person. Moreover, the instant auto- 
mated concept may be applied for use with other types 
of automated and/or remote controlled machines, such 
as production drills, explosive loaders, robots, trucks, 
scoop trams, loaders, etc. 

[0054] While in accordance with the provisions of the 
statute, there are illustrated and described herein spe- 
cific embodiments of the invention, those skilled in the 
art will understand that changes may be made in the 
form of the invention covered by the claims and that cer- 
tain features of the invention may sometimes be used 
to advantage without a corresponding use of the other 
features. 



Claims 

1. A system for determining a position of an object, 
said system comprising: 

means for determining an initial reference point 
of said object; 

means for estimating a position of said object 
after said object has moved from said initial ref- 
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erence point; 

means for scanning at least one image of a sur- 
face in proximity to said object and converting 
said at least one image into a patch of point 
cloud data; 

means for approximately matching said patch 
of point cloud data with a portion of point cloud 
data stored within at least one database, 
wherein said point cloud data stored within said 
at least one database represents the topogra- 
phy of a region which includes said surface in 
proximity to said object; and 
at least one processor for executing program- 
mable instructions for determining a particular 
location of said region represented by said por- 
tion of point cloud data, wherein said object is 
determined to be positioned in proximity to said 
particular location. 

2. The system according to Claim 1, further compris- 
ing means for updating at least one processor as- 
sociated with said object with the determined posi- 
tion of said object. 

3. The system according to Claim 1, further compris- 
ing display means for displaying at least the deter- 
mined position of said object. 

4. The system according to Claim 1, further compris- 
ing: 

a survey system having means for obtaining 
mapping data representing the topography of 
said region and means for outputting said map- 
ping data, said means for obtaining mapping 
data preferably including a three-dimensional 
sensor for mapping the topography of said re- 
gion along the X, Y and Z axes; 
converting means for receiving said mapping 
data and converting said mapping data into 
said point cloud data; and 
at least one network device for receiving said 
point cloud data from said converting means 
and routing said point cloud data to said at least 
one database. 



means for determining said initial reference point of 
said object and said means for scanning said at 
least one image of said surface in proximity to said 
object for transmitting at least one signal to said 
5 means for determining and said means for scan- 
ning, said operator console preferably being con- 
nected to said at least one database and at least 
one network device via a data bus. 

10 7. The system according to Claim 1 , further compris- 
ing a laser system coupled to said object for deter- 
mining the distance of said object from an obstacle 
located in proximity to said object. 

*5 8. The system according to Claim 1, wherein said 
means for scanning includes a camera system hav- 
ing three lenses, with one lens being oriented in the 
X-axis, one lens being oriented in the Y-axis, and 
one lens being oriented in the Z-axis, wherein said 

20 camera system scans said surface in three dimen- 
sions. 

9. The system according to Claim 1, wherein said 
point cloud data stored within said at least one da- 

25 tabase represents the topography of said region in 
three dimensions. 

10. The system according to Claim 1 , wherein said sys- 
tem further comprises a diagnostic terminal system 

30 for executing diagnostic procedures for checking 
the integrity of said system. 

11. The system according to Claim 1, wherein said re- 
gion is selected from the group consisting of a mine, 

35 a tunnel, a cave, a building, and an overhead sur- 
face. 



40 



45 



5. The system according to Claim 1, wherein said at 
least one processor further executes programma- 
ble instructions for removing a subset of point cloud 
data from said at least one database, wherein said 50 
removed subset of point cloud data includes said 
portion of point cloud data representing said partic- 
ular location, said portion of point cloud data pref- 
erably being a subset of said removed subset of 
point cloud data. 55 



6. The system according to Claim 1 , further compris- 
ing an operator console in communication with said 
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